
Monitoring Quality of Service in Packet-Based 

Communications 

Field of the invention 

5 The present invention relates to the monitoring of 
quality of service information in packet-based 
communications. The invention has particular 
. application in packet-based telephony. 

10 Background Of The Invention 

Many parameters such as network and codec delay, packet 
loss, codec performance affect the user's perception of 
the quality of service (QoS) of a packet-based 
telephony call, as compared to an end-to end TDM 
15 telephone call. 

The Nortel Networks "Meridian" Internet Telephony 
Gateway Trunk ("Meridian" is a Trade Mark) can measure 
the latency and packet loss during a telephone call 

20 using the Internet Protocol. These factors directly 

affect the perceived QoS and can be used to generate a 
measurement of network performance during a call. If 
the measurement of network performance drops below a 
predetermined value, the system can be programmed to 

25 switch the call from the switched packet network to a 
conventional analog network, thereby ensuring that the 
user has an acceptable level of call quality at all 
times . 



However, users do not themselves currently have any way 
of monitoring the QoS in an objective way. Users can 
only give subjective reactions that the QoS has 
improved or declined during a call. 
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transmission delay between endpoints, a useful measure 
of quality of service can be calculated and 
subsequently presented to a user at an endpoint, 
allowing the user to monitor the QoS as it varies xn 
real time during the call. This gives the user added 
value for call set-up, as the QoS provided by different 
service providers can be compared. Alternatively, 
users might obtain rebates for call charges in respect 
of calls where the QoS was below a predefined level. 
It also benefits the suppliers of endpoint equipment, 
since a dynamic QoS monitoring feature will be 
attractive to customers of the equipment. 

The presentation of this information can be by any 
useful means, such as: a green LED to indicate 
acceptable QoS and a red LED to indicate unacceptable 
QOS; a QOS indication bar on a handset or terminal 
display which varies in length as the QoS varies; an 
aural tone audible to the user when the QoS drops below 
a predetermined level; or a numerical display providing 
a numerical indication of QoS on a scale of e.g. 1-5, 
to give but a few examples. 

An important application of the invention is in voice 
telephony calls made over an IP (Internet Protocol) 
based network such as the Internet, or over a local 
area network which operates in much the same way as the 
Internet (e.g. a local area network or LAN). This type 
of telephony is referred to as Voice over Internet 
Protocol or VoIP telephony. 

3 In VOIP calls, the voice signals are converted into a 
series of discrete packets of data. The packets which 
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include addressing information, are sent independently 
of one another over the network, passing through a 
series of nodes from source to destination. Two 
consecutive packets might follow entirely different 

5 routes to the destination, and if it happened that one 
route was more congested than the other, packets on the 
congested route could be delayed or lost. Accordingly 
each packet of data includes not only the voice signal 
data and the addressing information, but also 

10 sequencing information to enable the computer which 

receives the individual data packets to piece them back 
together in the correct order and recreate the original 
voice signal. 

15 As packets can be lost when travelling the network or 
as they can be delayed (depending on the route 
travelled, which is not a fixed route) , the percentage 
packet loss and the delay time of packets travelling 
from source to destination are the two transmission 

20 characteristics most likely to vary in real time and 
have a noticeable effect on the QoS. 

Accordingly, in addition to the voice signal packets, 
the invention involves also sending a series of test 
packets. In one embodiment, the test packets are sent 

25 from source to destination and then returned. By 

measuring how many packets are not returned, a measure 
of percentage packet loss for these test packets can be 
calculated. In statistical terms this percentage 
packet loss will apply equally to the voice signal 

30 packets which were sent during the same time period, 
and thus the percentage figure for the test packets 
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provides a measure of how many voice signal packets 
have been lost. 

preferably, therefore, the test packets Include a first 
series of test packets which issue from a source 

5 location to a destination location and a second serres 
of test packets which issue from the destination 
location to the source location ih response to the 
first series of test packets, whereby the network 
characteristics may be monitored by comparing the 

10 and second series of test packets. 

one can regard the second series of test packets as 
being the first series "bounced back" from the 
destination, or as bein, new packets generated by the 
destination location; the difference is not material 

15 the invention. 

^ measure of packet loss is obtained by comparing the 
packets issued from the source location and the packets 
received back at the source locatron. 

The first series of test packets will preferably 
include local source timestamp information and the 
second series of test packets will preferably include 
iccal destination timestamp information, the drfterence 
between the source and destination timestamp 
information being, used to calculate a delay 
characteristic of the network. 

This delay characteristic is preferably the absolute 
delay in echo-free connections (Ta) between the source 
and destination locations over the network. 



20 
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Technology is currently in place to generate 
synchronised timestamps on individual data packets at 
different locations within the network. The Internet 
Engineering Task Force (IETF) has an approved method of 
5 gaining accurate time stamp information from a 

centralised time server on a network (IETF Network Time 
Protocol - RFC 1305) . Data packets can be issued from 
a source location with local source timestamp 
information, and sent between nodes on the network at 
10 regular intervals. On receipt by a node they are 

immediately bounced back to the originator with local 
timestamp information added. This allows the value of 
Ta to be calculated. 

voice quality on a packet network is dependent on a 
15 large number of factors, a list of which is given in 

ITU-T Recommendation G.107 version 05/00 (issued by the 
Telecommunication Standardization Sector of the 
International Telecommunication Union) . No one factor 
exclusively determines voice quality - it is the 
20 combined effect of these factors that determines the 
overall voice quality. 

The invention takes advantage of the fact that those 
factors which vary in a real-time way are largely 
25 dependent on a few simple transmission characteristics 
of packets travelling between the two parties. 

ITU-T Recommendation G.107 provides a computational 
model, the E-Model, to determine the combined effect of 
30 various parameters on voice quality. The model 
evaluates the end-to-end network transmission 
performance and outputs a scalar rating "R" for the 
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network transmission quality. The model further 
correlates the network objective measure, "R", with the 
subjective QoS metric for voice quality, MOS . The MOS 
or Mean Opinion Score is a subjective measurement of 
voice quality, and ranges from 1 to 5, where 1 is bad 
voice quality and 5 is excellent. 

The value of R depends on a wide range of factors: 
Sending Loudness Rating; Receiving Loudness Rating; 
Sidetone Masking Rating; Listener Sidetone Rating; D- 
Value of Telephone, Send Side; D-Value of Telephone 
Receive Side; Talker Echo Loudness Rating; Weighted 
Echo Path Loss; Mean one-way Delay of the Echo Path; 
Round Trip Delay in a 4-wire Loop; Absolute Delay in 
echo-free Connections; Number of Quantization 
Distortion Units; Equipment Impairment Factor; Circuit 
Noise referred to 0 dBr-point; Noise Floor at the 
Receive Side; Room Noise at the Send Side; Room Noise 
at the Receive Side; and Advantage Factor. All of 
these factors are detailed more clearly in the ITU-T 
Recommendation G.107, and are used to calculate R. 

Recommendation G.107 provides the following general 
formula for R: 

R = Ro - Is - Id - le + A 



Ro is the basic signal-to-noise ratio, including noise 
sources such as circuit noise and room noise. Is is a 
combination of all impairments which occur more or less 
simultaneously with the voice signal. Id represents 
the impairments caused by delay. The term Ro and the 
Is and Id values are subdivided into further specific 
impairment values. The Recommendation give the formulae 
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used in the E-model to generate Ro, Is, Id, based on 
the wide range of factors listed above. 

The equipment impairment factor le represents 
impairments caused by low bit rate codecs and packet 
losses over the network, and is discussed below. 

The advantage factor A allows for compensation of 
impairment factors when there are other advantages of 
access to the user. A user on a conventional wirebound 
call can expect higher clarity of signal than a user on 
a satellite call in a remote uninhabited location, for 
example. This means that the satellite user is 
prepared to put up with a lower QoS than the wirebound 
15 user. Because the E model is intended to be used to 
correlate the network objective measure, R, with a 
subjective MOS score, R is weighted by the advantage 
factor to take into account this psychological 
expectation factor or advantage factor A. 

20 

Examples given for maximum values of A are: 
Conventional (wirebound) telephony, A=0; the advantage 
of mobility by cellular networks in a building gives 
A=5; the advantage of mobility in a geographical area 
25 or moving in a vehicle gives A=10; the advantage of 

access to hard-to-reach locations, e.g. via multi-hop 
satellite connections gives A=20. These values are 
provisional only. 



30 



Deriving le in real-time from pac ket loss and the codec 



type: 



In a packet based network, such as an IP Network, the 
equipment impairment factor (le) is specifically 
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related to the communications codec type chosen for the 
call and the packet loss incurred across the network. 
Packet loss can be incurred due to network congestion 
or equipment out of service and subsequent failover. By 
5 empirical measurement of MOS scores (i.e. the users' 
perception of quality of service for different 
percentage packet loss values, all other factors being 
equal) under test conditions for specific test induced 
packet loss or otherwise it is possible to tabulate the 
10 le for percentage packet loss criteria for the codec 
types used by the equipment. These tables may then be 
used in real-time to derive a value for le based on the 
real-time measurement of packet loss in the network and 
for the codec type in use at that time. 

15 

The factor Id was mentioned above as representing the 
impairments caused by delay. It is composed of 
impairments due to Talker Echo (Idte), impairments due 
to Listener Echo (Idle), and impairments caused by too- 
20 long absolute delay Ta, which occur even with perfect 

echo cancelling (Idd) . Idd is the factor which is most 
important in terms of variations during a call which 
have a significant effect on QoS . 



25 



30 



Deriving Idd in real-time: 

For packet based networks, such as an IP network, the 
Absolute Delay in echo-free Connections (Ta) is 
specifically related to the impairments represented by 
the factor Idd. Ta can vary in real-time due to the 
dynamic nature of packet based networks, which allow 
multiple routes between destinations and each packet 
may be routed via different physically equipment 
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depending on various network factors such as 
instantaneous load or equipment out of service. 

TO measure Idd, bursts of packets containing timestamp 
5 information gained from a centralised time server, 

using protocols such as the IETF Network Time Protocol 
- RFC 1305, are exchanged between nodes on the network 
at regular intervals. On receipt by a node they are 
immediately bounced back to the originator with local 
10 timestamp information added, and from the two 

timestamps, the absolute delay in echo-free connections 
(Ta) is calculated. These same packets are also used 
to detect lost packets as described above. 

15 The delay impairment factor (Idd) is given by the 

formulae : 

(i) for Ta < 100ms, 
Idd - 0; and 



20 



(ii) for Ta => 100 ms , 

Idd = 25M(l+X6)l/6 - 3MH-{X/3)6)l/5 + 2) 

Where X = { log (Ta / 100 ) )7 log { 2 ) 

2 5 Derivation of R from le and Idd 

From the formula given above for R: 

R - Ro - Is - Id - le + A 

30 a real-time value for R can be derived if assumptions 
are made that Ro, Is and A have fixed values, and that 
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the components Idte and Idle are also fixed for the 
duration of a call. 

Recommendation G.107 gives default values for all of 
5 the factors mentioned in the Recommendation, but these 
defaults can be varied to take account of equipment- 
specific, network-specific, or environment-specific 
parameters. Using the default values given, one 
arrives at a figure of R=93.2, indicating very high 
10 voice quality . 

We have found that for a VoIP implementation over a 
Wide Area Network (WAN) using the Nortel Networks 
Meridian Integrated IP Telephony Gateway product 
15 family, the generalised formula for R can be replaced 



with a value of Y = 94.5 which is the laboratory 
20 measured figure for all the non-realtime varying 
parameters . 

The constant Y is higher than the default of R = 93.2, 
but is adjusted downwards by the combined effects of 
25 packet loss and absolute delay. Different equipment 
may result in a different value being chosen for the 
constant other than 94.5. 

The value of Y is preferably from about 92 to about 98, 
more preferably from about 93 to about 96. 



by : 



R 



= Y - (le + Idd) 



30 
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Calculation of MPS score from R 

Since R is an objective rather than a subjective 
measure of QoS, the calculated value of R is preferably 
correlated to a subjective metric for the quality of 
service, and an indication of this subjective value is 
provided to the user. Recommendation G.107 provides a 
formula for deriving the subjective Mean Opinion Score 
(MOS) from the R value: 

MOB = 1 + 0.035R + R(R-60) (100-R) (7x10"^) 

The value of R should first be checked to ensure it is 
in the range 1 to 100. If R is less than zero, MOS is 
set at 1 and if R is greater than 100, MOS is set at 
4.5. 

The MOS scale lies from 1 to 5, but scores below 2 or 3 
may effectively indicate QoS so low as to be 
unacceptable. Accordingly, MOS scores in the range 
e.g. 2.5 to 5 can be normalised in the method of the 
invention to a more useful indication. An example 
might be to emit a warning tone or illuminate a warning 
LED on the handset if the MOS drops below 3, for 
example. Alternatively, the calculated MOS scores can 
be normalised so that values indicating acceptable call 
quality (e.g. from 2.5 or 3 to 4.5 or 5) are expanded 
out to a five or ten point scale. 

The method of the invention may also include the step 
of providing, at the request of a user, an indication 
of one or more of said transmission characteristics. 
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This user request may be made by means of an input 
device associated with the endpoint and the indication 
may be provided by means of a display device associated 
with the endpoint. 

For example, the endpoint may be a computer terminal 
having a microphone and speaker associated with it, 
which acts as a telephone when the required software is 
running on the computer. In such cases, a menu could 
be provided for the user to call up individual 
transmission characteristics such as percentage packet 
loss (current or historical) and absolute one-way delay 
times from endpoint to endpoint (or if the other 
endpoint is connected to the packet-based network by 
means of a conventional PSTN and a gateway, the delay 
point time from the user's endpoint to the gateway at 
the other end of the call) . 

Other parameters available to the endpoint could also 
be called up by the menu, such as the codec being used. 
The output device could be the computer VDU . 

Alternatively, the endpoint might be an ethernet 
telephony set which connects directly to the network, 
in which case, the input device could be the telephony 
set keypad, and the display device an LCD display on 
the handset . 

The method may also include the step of logging the 
network transmission characteristics, or of logging the 
results of the calculations of network performance. 
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Optionally, the logging might occur only when the 
results are within a predetermined range. An example 
might be a system which monitors the network 
performance, displays a red light or emits a warning 
beep when the QoS drops below an acceptable level, and 
records this event in a log. The user might then be 
able to obtain a rebate for the call, or for part of 
the call charge. 

The logging could also include logging an occurrence o; 
a communications connection over the network being 
lost, i.e. if a call has been dropped as a result of a 
deterioration in network performance. 

The method of the invention can also include adjusting 
a billing record for the user in dependence on the 
results of said calculation. Thus, the service 
provider might automatically adjust charges for the 
user based on a below-acceptable level of QoS. 

In a further aspect the invention provides a computer 
program which when executed causes a computer 
associated with the endpoint to: 

monitor transmission characteristics of test 
packets transmitted across the network; 

dynamically calculate from the transmission 
characteristics a measure of network performance; and 

provide the user with a dynamic indication of the 
network performance based on the calculation. 

The computer program can operate the method of the 
invention as detailed above, and can also be 
responsible for aspects of billing and logging. 
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The invention further provides a telephone handset for 
connection to a packet-based network, having a display 
device for displaying a dynamic indication of network 
performance based on the transmission characteristics 
of test packets transmitted across a network to which 
the handset is attached. 

The handset will preferably further include a processor 
for calculating a measure of network performance based 
on the transmission characteristics of test packets 
transmitted by the handset across the network. 

in a further aspect the invention provides a system for 
monitoring quality of service in communications over a 
packet-based network, comprising: 

a source endpoint connected to the network via 
which a user may transmit communication signals over 

the network; 

a test packet generator for transmitting test 

packets across the network 

a test packet receiver for receiving test packets 

from the network; 

a processor for measuring transmission 
characteristics of the test packets and for calculating 
from said transmission characteristics a measure of 
network performance; and 

an output device associated with the endpoint for 
providing a dynamic indication of the network 
performance based on said calculation. 
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Preferably, the test packet generator includes a 
timestamp generator for adding a local source timestamp 
to the test packets. 

Further, preferably, the' system includes a destination 
5 endpoint with which the source endpoint is in 
communication over the network, the destination 
endpoint having associated therewith: a test packet 
receiver for receiving test packets from the network; a 
timestamp generator for adding a local destination 
10 timestamp to the received test packets; and a test 

packet re-transmitter for re-transmitting the received 
test packets with the local destination timestamp back 
to their source. 

The system may also include a centralised time server 
15 in communication with the network for generating a 

standardised time and providing this to the source and 
destination endpoints . 

Brief Description of Drawings 

20 The invention will now be illustrated by the following 
descriptions of embodiments thereof given by way of 
example only with reference to the accompanying 
drawings, in which: 

25 Fig. 1 is an architecture of a system according to the 
invention; 

Fig. 2 is a flowchart illustrating the steps carried 
out in a preferred embodiment of the method of the 
30 invention; and 
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Fig. 3 is a schematic view of a handset according to 
the invention. 

Detailed Description of Preferred Embodiments 

Fig. 1 shows a packet-based network 10, comprising a 
number of inter-connected nodes 12. The network may be 
the Internet, or it may be any other packet-based 
network. A pair of call servers 14, 16 are connected 
to nodes 12 of the network. Each call server has a 
number of terminals or handsets 18 associated with it, 
from which users may make telephone calls over the 
network. The handsets 18 are connected directly to 
nodes 12 of the network and are logically connected. to 
the respective call servers 14,16. In Fig. 1 only a 
single handset 18 is shown for each call server, and 
the logical connection is denoted by a dotted line. 
For convenience, server 14 is referred to as the source 
call server, and server 16 as the destination call 
server . 

The servers and handsets may be replaced by computers 
connected to the network having associated ethernet 
handsets . 

The computers could also be used for video-conferencing 
or other network-based communications, to which the 
invention would be equally applicable. 

Also connected to the network 10 is a centralised time 
server 20, which enables both servers 14,16 to generate 
synchronised timestamps, in accordance with IETF 
Network Time Protocol RFC 1305. 
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Referring additionally to Fig. 2, when a VoIP call is 
made between the two handsets 18 (step 22), both 
handsets begin the transmission and receipt of signal 
packets, in the normal way, step 24. The source server 
14 also begins transmission and receipt of test 
packets, step 26. The destination server could also 
begin its own transmission of test packets. (The test 
packets could instead be transmitted directly to or 
from the handsets, if the handsets are provided with 
the necessary functionality to generate such test 
packets . ) 

The test packets include source and destination header 
information allowing them to be routed to the 
destination server by the intervening nodes in the 
network, and returned back to the source. The test 
packets also contain timestamp information indicating 
the time of transmission from the source, as 
synchronised with time server 20. When the destination 
server receives a test packet it timestamps it with the 
time of receipt at the destination server 16, and re- 
routes it with this additional information back to the 
source . 

The source call server 14 monitors the percentage of 
packets returned in this way, and derives a percentage 
value for packets lost, step 28. Controlling software 
running on the server 14 then correlates this 
percentage with the codec being used for the call in a 
correlation table (step 30) and reads from this table a 
value for the equipment impairment factor le. This 
table will be stored on the server, and the table will 
have been calibrated beforehand under test conditions 
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to provide the correct le value for all of the codecs 
used by the server in making calls. 

The le value is then stored for later calculations, 
5 step 32. 

When the test packets are received back with the 
destination time stamp information, step 26, the 
software on the server makes a parallel calculation of 
10 the average one-way total transmission delay (Ta) for 
the packets received back during a short period of 
time , step 34 . 

The value of Ta is then examined to see if it is less 
15 than 100 ms, step 36. If so, then the variable Idd is 
set at .zero, step 38, to reflect the fact that the 
algorithm delay times of less than 100 ms as being 
acceptable for high-quality voice calls . 

20 If Ta is equal to or greater than zero, then a value 
for Idd is calculated according to the formulae: 

Idd - 25^ ( (1+X^) - 3^ (1+ (X/3) ^) + 2) 

25 Where X = ( log ( Ta/ 1 00 ) ) /log ( 2 ) 

These formulae are calculated in reverse order, 
naturally, with X being determined in step 40 and Idd 
in step 4 2. 

30 The stored values of le and Idd are then used to 
calculate R (step 44) according to the formula: 
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R = Y - Idd - le, 

with Y set at a value of 94.5 (a value previously 
obtained during testing for a Nortel Networks Meridian 
5 IP Telephony Gateway conducting VoIP calls). Different 
equipment set-ups might use different values for Y. 

The value thus derived for R is converted to more 
subjective MOS score (step 46) according to the 
10 formula: 

MOS = 1 + 0.035R + R(R-60) (100-R) (7x10"^) 

(Optionally, in accordance with Recommendation G.107, 
15 the value of R can first be filtered to check if it is 
in the range 1 to 100. If R is less than zero, MOS is 
set at 1 and if R is greater than 100, MOS is set at 
4.5-. In practice, this step may be unnecessary, since 
the R values for any useful figures of packet loss and 
20 delay will always be in the range of zero to 100) . 

The MOS scale lies from 1 to 5, but scores below 2 or 3 
may effectively indicate QoS so low as to be 
unacceptable. Accordingly, MOS scores in the range 
25 e.g, 2.5 to 5 can be normalised (step 48) to a zero to 
5 point scale for display purposes. MOS scores of 2.5 
or less are normalised to zero, and higher scores are 
converted, according to the following table: 
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CALCULATED MOS SCORE 


NORM.ALISED DISPLAY VALUE 


2.5 - 3.0 


1 


3.0 - 3.5 


2 


3.5 - 4.0 


3 


4.0 - 4.5 


4 


4.5 - 5.0 


5 



The display values are then output to a display unit 
(step 50) on the handsets 18, an example of which is 
5 shown in Fig. 3. The handset includes a conventional 
keypad array 60 and a cradle 62 for a conventional 
handheld unit (not shown) incorporating earpiece and 
mouthpiece. The handset also includes a built-in 
loudspeaker 64 and a display unit 66. 

10 

Display unit 66 displays information relating to the 
call, such as internal line number and dialled number 
(or the number of the calling party, if the call was 
received rather than initiated from the handset shown) . 

15 The display unit further shows a series of five 

indicator bars 68a-68e to indicate the QoS display 
value as calculated in the method of Fig. 2. This is 
shown as ''QoS strength'' which in fact is a measure of 
the system parameters as predetermined by the constant 

20 value of 94.5, and more particularly of the dynamic 
variations from the optimum QoS due to packet losses 
and transmission delays. 

In the handset shown in Fig. 3, indicator bars 68a-68c 
25 are darkened to indicate a display value of 3, 
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corresponding to a MOS value of 3.5-4,0, which is a 
relatively high quality voice signal. 

Returning to Fig . 2, the software enters a continuous 
5 loop by checking whether the call is still active (step 
52), and if so, returning to steps 28 and 34 for 
further updating of the display value in the light of 
current delays and packet losses. 

10 The invention is not limited to the embodiments 

described herein which may be varied without departing 
from the spirit of the invention. 
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